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METHOD AND SYSTEM FOR MANAGEMENT OF LOGICAL NETWORKS FOR 
MULTIPLE CUSTOMERS WITHIN A NETWORK MANAGEMENT FRAMEWORK 

BACKGROUND OF THE INVENTION 

5 

1 . Field of the Invention 

The present invention relates to an improved data 
processing system and, in particular, to a method and system 
for multiple computer or process coordinating. Still more 
10 particularly, the present invention provides a method and 
system for network management. 

2 . Description of Related Art 

Technology expenditures have become a significant 

15 portion of operating costs for most enterprises, and 

businesses are constantly seeking ways to reduce information 
technology (IT) costs. This has given rise to an increasing 
number of outsourcing service providers, each promising, 
often contractually, to deliver reliable service while 

20 offloading the costly burdens of staffing, procuring, and 
maintaining an IT organization. While most service 
providers started as network pipe providers, they are moving 
into server outsourcing, application hosting, and desktop 
management. For those enterprises that do not outsource, 

25 they are demanding more accountability from their IT 

organizations as well as demanding that IT is integrated 
into their business goals. In both cases, "service level 
agreements" have been employed to contractually guarantee 
service delivery between an IT organization and its 

30 customers. As a result, IT teams now require management 

solutions that focus on and support "business processes" and 
"service delivery" rather than just disk space monitoring 
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and network pings. 

IT solutions now require end-to-end management that 
includes network connectivity, server maintenance, and 
application management in order to succeed. The focus of IT 
5 organizations has turned to ensuring overall service 
delivery and not just the "towers" of network, server, 
desktop, and application. Management systems must fulfill 
two broad goals: a flexible approach that allows rapid 
deployment and configuration of new services for the 

10 customer; and an ability to support rapid delivery of the 
management tools themselves. A successful management 
solution fits into a heterogeneous environment, provides 
openness with which it can knit together management tools 
and other types of applications, and a consistent approach 

15 to managing all of the IT assets. 

With all of these requirements, a successful management 
approach will also require attention to the needs of the 
staff within the IT organization to accomplish these goals: 
the ability of an IT team to deploy an appropriate set of 

20 management tasks to match the delegated responsibilities of 
the IT staff; the ability of an IT team to navigate the 
relationships and effects of all of their technology assets, 
including networks, middleware, and applications; the 
ability of an IT team to define their roles and 

25 responsibilities consistently and securely across the 
various management tasks; the ability of an IT team to 
define groups of customers and their services consistently 
across the various management tasks; and the ability of an 
IT team to address, partition, and reach consistently the 

30 managed devices. 

Many service providers have stated the need to be able 
to scale their capabilities to manage millions of devices. 
When one considers the number of customers in a home 
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consumer network as well as pervasive devices, such as smart 
mobile phones, these numbers are quickly realized. 
Significant bottlenecks appear when typical IT solutions 
attempt to support more than several thousand devices . 

5 Given such network spaces, a management system must be 

very resistant to failure so that service attributes, such 
as response time, uptime, and throughput, are delivered in 
accordance with guarantees in a service level agreement. In 
addition, a service provider may attempt to support many 

10 customers within a single network management system. The 
service provider's profit margins may materialize from the 
ability to bill usage of a common management system to 
multiple customers . 

On the other hand, the service provider must be able to 

15 support contractual agreements on an individual basis. 
Service attributes, such as response time, uptime, and 
throughput, must be determinable for each customer. In 
order to do so, a network management system must provide a 
suite of network management tools that is able to perform 

20 device monitoring and discovery for each customer's network 
while integrating these abilities across a shared network 
backbone to gather the network management information into 
the service provider's distributed data processing system. 
There is a direct relationship between the ability of a 

25 management system to provide network monitoring and 
discovery functionality and the ability of a service 
provider using the management system to serve multiple 
customers using a single management system. Preferably, the 
management system can replicate services, detect faults 

30 within a service, restart services, and reassign work to a 
replicated service. By implementing a common set of 
interfaces across all of their services, each service 
developer gains the benefits of system robustness. A 
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well-designed, component-oriented, highly distributed system 
can easily accept a variety of services on a common 
infrastructure with built-in fault-tolerance and levels of 
service . 

5 Distributed data processing systems with thousands of 

nodes are known in the prior art. The nodes can be 
geographically dispersed, and the overall computing 
environment can be managed in a distributed manner. The 
managed environment can be logically separated into a series 

10 of loosely connected managed regions, each with its 
management server for managing local resources. The 
management servers coordinate activities across the 
enterprise and permit remote site management and operation. 
Local resources within one region can be exported for the 

15 use of other regions in a variety of manners. 

As with most organizations, an IT organization, such as 
a service provider, may classify its personnel into 
different managerial roles. Given a scenario in which a 
service provider is using an integrated network management 

20 system for multiple customers, it is most likely that many 
different individuals will be assigned to manage different 
customers, different regions, and different groups of 
devices. In addition, separate individuals may have 
different duties within similar portions of the network, 

25 such as deploying new devices versus monitoring the uptime 
of those devices, and the management system should be able 
to differentiate the roles of the individuals and to 
restrict the actions of any particular individual to those 
operations that are appropriate for the individual's role. 

30 In a highly distributed system comprising on the order of a 
million devices, the task of authenticating and authorizing 
the actions of many individuals per customer, per region, 
per device, etc., becomes quite complex. 
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Typically, the network management system configures a 
security context for the network administrator, for example, 
by assigning a specific class of privileges to the 
administrator based on the administrator's role or group. 

5 Within a runtime environment, the administrator can attempt 
to perform certain administrative functions that are not 
allowed to be performed by the average user. For example, a 
particular administrator may be responsible for maintaining 
a particular subnet of devices with a range of IP addresses 

10 between X.Y.Z.O and X.Y.Z.255. At some point, the 

administrator may log into the management system and attempt 
to manage a device at address X.Y.Z.5. The network 
management system must determine whether to allow the 
administrator to perform the management function on that 

15 particular device. 

In some systems, the authentication and authorization 
process occurs solely at the time of the login operation. 
If the administrator has been authenticated and is 
authorized to use a particular application, then the system 

20 allows the application to perform all of its actions without 
further authorization checks. With this type of system, 
however, it is difficult to achieve the granularity of 
control that is necessary for a service provider with 
multiple customers within a highly distributed system in 

25 which different sets of administrators have responsibility 
for different customers. 

Therefore, it would be particularly advantageous to 
provide a method and system within a network management 
framework for flexibly managing multiple customers within a 

30 highly distributed system. It would be particularly 

advantageous for the network management system to provide 
security while allowing for dynamic changes in 
administrative responsibility for various networks and 
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SUMMARY OF THE INVENTION 

A method, system, apparatus, and computer program 
product is presented for management of a distributed data 
5 processing system on behalf of a plurality of management 
customers. The distributed data processing system is 
logically represented as a set of scopes, wherein a scope is 
a logical organization of network-related objects. The 
network-related objects may be generated by dynamically 

10 discovering endpoints, systems, and networks within the 
distributed data processing system, which are then 
correspondingly represented as a set of endpoint objects, 
system objects, and network objects, any of which may be 
labeled as a network-related object. The endpoint objects, 

15 system objects, and network objects are logically organized 
into a set of scopes, and each endpoint object, each system 
object, and each network object is uniquely assigned to a 
scope such that scopes do not logically overlap. Each scope 
is uniquely assigned to a management customer. The 

20 distributed data processing system is managed as a set of 
logical networks in which a logical network contains a set 
of scopes and in which each logical network is uniquely 
assigned to a management customer. An administrative user 
may dynamically reconfigure the logical networks within the 

25 distributed data processing system while managing the 
logical networks for a set of customers. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

5 The novel features believed characteristic of the 

invention are set forth in the appended claims. The 
invention itself, further objectives, and advantages 
thereof, will be best understood by reference to the 
following detailed description when read in conjunction with 
10 the accompanying drawings, wherein: 

Figure 1 is a diagram depicting a known logical 
configuration of software and hardware resources; 

Figure 2A is simplified diagram illustrating a large 
distributed computing enterprise environment in which the 
15 present invention is implemented; 

Figure 2B is a block diagram of a preferred system 
management framework illustrating how the framework 
functionality is distributed across the gateway and its 
endpoints within a managed region; 
20 Figure 2C is a block diagram of the elements that 

comprise the low cost framework (LCF) client component of 
the system management framework; 

Figure 2D is a diagram depicting a logical 
configuration of software objects residing within a hardware 
25 network similar to that shown in Figure 2A; 

Figure 2E is a diagram depicting the logical 
relationships between components within a system management 
framework that includes two endpoints and a gateways- 
Figure 2F is a diagram depicting the logical 
30 relationships between components within a system management 
framework that includes a gateway supporting two DKS-enabled 
applications; 
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Figure 2G is a diagram depicting the logical 
relationships between components within a system management 
framework that includes two gateways supporting two 
endpoints; 

5 Figure 3 is a block diagram depicting components within 

the system management framework that provide resource 
leasing management functionality within a distributed 
computing environment such as that shown in Figures 2D-2E; 
Figure 4 is a block diagram showing data stored by a 
10 the IPOP (IP Object Persistence) service; 

Figure 5A is a block diagram showing the IPOP service 
in more detail ; 

Figure 5B is a network diagram depicting a set of 
routers that undergo a scoping process; 
15 Figure 5C depicts the IP Object Security Hierarchy; 

Figure 6 is a block diagram depicting a set of 
components that may be used to implement scope-based 
security access; 

Figure 7A is a flowchart depicting a portion of an 
20 initialization process in which a network management system 
prepares a security subsystem for user access to 
network-related objects; 

Figure 7B is a flowchart depicting further detail of 
the initialization process in which the DSC objects are 
25 initially created and stored; 

Figure 7C is a flowchart depicting further detail of 
the initial DSC object creation process in which DSC objects 
are created and stored for an endpoint /user combination; 
Figure 7D is a flowchart depicting further detail of 
30 the initial DSC object creation process in which DSC objects 
are created and stored for an endpoint/endpoint combination; 
Figure 8A is a flowchart depicting a process for 
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creating topology data; 

Figure 8B is a flowchart depicting a process for 
listening for physical network changes that affect topology 
objects; 

5 Figure 9A is a figure depicting a graphical user 

interface window that may be used by a network or system 
administrator to view the topology of a network that is 
being monitored; 

Figure 9B is a graphical user interface window that 
10 shows the topology of a network that has changed; 

Figure 10A is a block diagram depicting a known 
configuration of software and/or hardware network components 
linking multiple networks; 

Figure 10B is a block diagram depicting a service 
15 provider connected to two customers that each have subnets 
that may contain duplicate network addresses; 

Figure 11A is a block diagram showing a set of 
components that may be used to implement multi-customer 
management across multiple networks in which duplicate 
20 address may be presents- 
Figures 11B-11D are some simplified pseudo-code 
examples that depict an object-oriented manner in which 
action objects and endpoint objects can be implemented; 

Figure 12A is a flowchart depicting a portion of an 
25 initialization process in which a network management system 
prepares for managing a set of networks with multiple NATs; 

Figure 12B is a flowchart depicting further detail of 
the initialization process in which the administrator 
resolves addressability problems; 
30 Figure 12C is a flowchart depicting further detail of 

the process in which the administrator assigns VPN IDs; 
Figure 13 is a figure that depicts a graphical user 
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interface (GUI) that may be used by a network or system 

administrator to set monitoring parameters for resolving 

address collisions; 

Figure 14A is a flowchart showing the overall process 
5 for performing an IP "Ping" with in a multi-customer , 

distributed data processing system containing multiple 

private networks; and 

Figure 14B is a flowchart that depicts a process by 

which an administrator chooses the source endpoint and 
10 target endpoint for the IP "Ping" action described in an 

overall manner in Figure 14A; 

Figure 15 is a block diagram depicting a logical 

organization of network-related objects that may be managed 

within different scopes on behalf of multiple customers 
15 whose physical networks are being administered using the 

network management framework of the present inventions- 
Figure 16 is a flowchart depicting a process for 

handling certain types of scope-related events; and 

Figures 17A-17B are flowcharts depicting a process for 
20 relocating network-related objects based on an 

administrator-initiated change of scope or for configuring 

multiple customers within a distributed data processing 

system. 
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DETAILED DESCRIPTION OF THE INVENTION 

5 The present invention provides a methodology for 

managing a distributed data processing system. The manner 
in which the system management is performed is described 
further below in more detail after the description of the 
preferred embodiment of the distributed computing 

10 environment in which the present invention operates. 

With reference now to Figure 1, a diagram depicts a 
known logical configuration of software and hardware 
resources. In this example, the software is organized in an 
object-oriented system. Application object 102, device 

15 driver object 104, and operating system object 106 

communicate across network 108 with other objects and with 
hardware resources 110-114. 

In general, the objects require some type of 
processing, input /output, or storage capability from the 

20 hardware resources. The objects may execute on the same 

device to which the hardware resource is connected, or the 
objects may be physically dispersed throughout a distributed 
computing environment. The objects request access to the 
hardware resource in a variety of manners, e.g. operating 

25 system calls to device drivers. Hardware resources are 

generally available on a first-come, first-serve basis in 
conjunction with some type of arbitration scheme to ensure 
that the requests for resources are fairly handled. In some 
cases, priority may be given to certain requesters, but in 

30 most implementations, all requests are eventually processed. 

With reference now to Figure 2A, the present invention 
is preferably implemented in a large distributed computer 
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environment 210 comprising up to thousands of "nodes". The 
nodes will typically be geographically dispersed and the 
overall environment is "managed" in a distributed manner. 
Preferably, the managed environment is logically broken down 
5 into a series of loosely connected managed regions (MRs) 
212, each with its own management server 214 for managing 
local resources with the managed region. The network 
typically will include other servers (not shown) for 
carrying out other distributed network functions. These 

10 include name servers, security servers, file servers, thread 
servers, time servers and the like. Multiple servers 214 
coordinate activities across the enterprise and permit 
remote management and operation. Each server 214 serves a 
number of gateway machines 216, each of which in turn 

15 support a plurality of endpoints/terminal nodes 218. The 
server 214 coordinates all activity within the managed 
region using a terminal node manager at server 214. 

With reference now to Figure 2B, each gateway machine 
216 runs a server component 222 of a system management 

20 framework. The server component 222 is a multi-threaded 

runtime process that comprises several components: an object 
request broker (ORB) 221, an authorization service 223, 
object location service 225 and basic object adapter (BOA) 
227. Server component 222 also includes an object library 

25 229. Preferably, ORB 221 runs continuously, separate from 
the operating system, and it communicates with both server 
and client processes through separate stubs and skeletons 
via an interprocess communication (IPC) facility 219. In 
particular, a secure remote procedure call (RPC) is used to 

30 invoke operations on remote objects. Gateway machine 216 

also includes operating system 215 and thread mechanism 217. 
The system management framework, also termed 
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distributed kernel services (DKS) , includes a client 
component 224 supported on each of the endpoint machines 
218. The client component 224 is a low cost, low 
maintenance application suite that is preferably "dataless" 
5 in the sense that system management data is not cached or 

stored there in a persistent manner. Implementation of the 
management framework in this "client-server" manner has 
significant advantages over the prior art, and it 
facilitates the connectivity of personal computers into the 
10 managed environment. It should be noted, however, that an 
endpoint may also have an ORB for remote object-oriented 
operations within the distributed environment, as explained 
in more detail further below. 

Using an object-oriented approach, the system 
15 management framework facilitates execution of system 

management tasks required to manage the resources in the 
managed region. Such tasks are quite varied and include, 
without limitation, file and data distribution, network 
usage monitoring, user management, printer or other resource 
20 configuration management, and the like. In a preferred 
implementation, the object-oriented framework includes a 
Java runtime environment for well-known advantages, such as 
platform independence and standardized interfaces. Both 
gateways and endpoints operate portions of the system 
25 management tasks through cooperation between the client and 
server portions of the distributed kernel services. 

In a large enterprise, such as the system that is 
illustrated in Figure 2A, there is preferably one server per 
managed region with some number of gateways. For a 
30 workgroup-size installation, e.g., a local area network, a 

single server-class machine may be used as both a server and 
a gateway. References herein to a distinct server and one 
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or more gateway (s) should thus not be taken by way of 
limitation as these elements may be combined into a single 
platform. For intermediate size installations, the managed 
region grows breadth-wise, with additional gateways then 
being used to balance the load of the endpoints. 

The server is the top-level authority over all gateways 
and endpoints. The server maintains an endpoint list, which 
keeps track of every endpoint in a managed region. This 
list preferably contains all information necessary to 
uniquely identify and manage endpoints including, without 
limitation, such information as name, location, and machine 
type. The server also maintains the mapping between 
endpoints and gateways, and this mapping is preferably 
dynamic. 

As noted above, there are one or more gateways per 
managed region. Preferably, a gateway is a fully managed 
node that has been configured to operate as a gateway. In 
certain circumstances, though, a gateway may be regarded as 
an endpoint. A gateway always has a network interface card 
(NIC), so a gateway is also always an endpoint. A gateway 
usually uses itself as the first seed during a discovery 
process. Initially, a gateway does not have any information 
about endpoints. As endpoints login, the gateway builds an 
endpoint list for its endpoints. The gateway's duties 
preferably include: listening for endpoint login requests, 
listening for endpoint update requests, and (its main task) 
acting as a gateway for method invocations on endpoints. 

As also discussed above, the endpoint is a machine 
running the system management framework client component, 
which is referred to herein as a management agent. The 
management agent has two main parts as illustrated in Figure 
2C: daemon 226 and application runtime library 228. Daemon 
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226 is responsible for endpoint login and for spawning 
application endpoint executables. Once an executable is 
spawned, daemon 226 has no further interaction with it. 
Each executable is linked with application runtime library 
228, which handles all further communication with the 
gateway. 

Each endpoint is also a computing device. In one 
preferred embodiment of the invention, most of the endpoints 
are personal computers, e.g., desktop machines or laptops. 
In this architecture, the endpoints need not be high powered 
or complex machines or workstations. An endpoint computer 
preferably includes a Web browser such as Netscape Navigator 
or Microsoft Internet Explorer. An endpoint computer thus 
may be connected to a gateway via the Internet, an intranet, 
or some other computer network. 

Preferably, the client-class framework running on each 
endpoint is a low-maintenance, low-cost framework that is 
ready to do management tasks but consumes few machine 
resources because it is normally in an idle state. Each 
endpoint may be "dataless" in the sense that system 
management data is not stored therein before or after a 
particular system management task is implemented or carried 
out . 

With reference now to Figure 2D, a diagram depicts a 
logical configuration of software objects residing within a 
hardware network similar to that shown in Figure 2A. The 
endpoints in Figure 2D are similar to the endpoints shown in 
Figure 2B. Object-oriented software, similar to the 
collection of objects shown in Figure 1, executes on the 
endpoints. Endpoints 230 and 231 support application action 
object 232 and application object 233, device driver objects 
234-235, and operating system objects 236-237 that 
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communicate across a network with other objects and hardware 
resources . 

Resources can be grouped together by an enterprise into 
managed regions representing meaningful groups. Overlaid on 
these regions are domains that divide resources into groups 
of resources that are managed by gateways. The gateway 
machines provide access to the resources and also perform 
routine operations on the resources, such as polling. 
Figure 2D shows that endpoints and objects can be grouped 
into managed regions that represent branch offices 238 and 
239 of an enterprise, and certain resources are controlled 
by central office 240. Neither a branch office nor a 
central office is necessarily restricted to a single 
physical location, but each represents some of the hardware 
resources of the distributed application framework, such as 
routers, system management servers, endpoints, gateways, and 
critical applications, such as corporate management Web 
servers. Different types of gateways can allow access to 
different types of resources, although a single gateway can 
serve as a portal to resources of different types. 

With reference now to Figure 2E, a diagram depicts the 
logical relationships between components within a system 
management framework that includes two endpoints and a 
gateway. Figure 2E shows more detail of the relationship 
between components at an endpoint. Network 250 includes 
gateway 251 and endpoints 252 and 253, which contain similar 
components, as indicated by the similar reference numerals 
used in the figure. An endpoint may support a set of 
applications 254 that use services provided by the 
distributed kernel services 255, which may rely upon a set 
of platform-specific operating system resources 256. 
Operating system resources may include TCP/IP-type 
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resources, SNMP-type resources, and other types of 
resources. For example, a subset of TCP/IP-type resources 
may be a line printer (LPR) resource that allows an endpoint 
to receive print jobs from other endpoint s. Applications 
254 may also provide self-defined sets of resources that are 
accessible to other endpoints. Network device drivers 257 
send and receive data through NIC hardware 258 to support 
communication at the endpoint. 

With reference now to Figure 2F, a diagram depicts the 
logical relationships between components within a system 
management framework that includes a gateway supporting two 
DKS-enabled applications. Gateway 260 communicates with 
network 262 through NIC 264. Gateway 260 contains ORB 266 
that supports DKS-enabled applications 268 and 269. Figure 
2F shows that a gateway can also support applications. In 
other words, a gateway should not be viewed as merely being 
a management platform but may also execute other types of 
applications . 

With reference now to Figure 26, a diagram depicts the 
logical relationships between components within a system 
management framework that includes two gateways supporting 
two endpoints. Gateway 270 communicates with network 272 
through NIC 274. Gateway 270 contains ORB 276 that may 
provide a variety of services, as is explained in more 
detail further below. In this particular example, Figure 26 
shows that a gateway does not necessarily connect with 
individual endpoints. 

Gateway 270 communicates through NIC 278 and network 
279 with gateway 280 and its NIC 282. Gateway 280 contains 
ORB 284 for supporting a set of services. Gateway 280 
communicates through NIC 286 and network 287 to endpoint 290 
through its NIC 292 and to endpoint 294 through its NIC 296. 
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Enclpoint 290 contains ORB 298 while endpoint 294 does not 
contain an ORB. In this particular example, Figure 26 also 
shows that an endpoint does not necessarily contain an ORB. 
Hence, any use of endpoint 294 as a resource is performed 
solely through management processes at gateway 280. 

Figures 2F and 2G also depict the importance of 
gateways in determining routes/data paths within a highly 
distributed system for addressing resources within the 
system and for performing the actual routing of requests for 
resources. The importance of representing NICs as objects 
for an object-oriented routing system is described in more 
detail further below. 

As noted previously, the present invention is directed 
to a methodology for managing a distributed computing 
environment. A resource is a portion of a computer system's 
physical units, a portion of a computer system's logical 
units, or a portion of the computer system's functionality 
that is identifiable or addressable in some manner to other 
physical or logical units within the system. 

With reference now to Figure 3, a block diagram depicts 
components within the system management framework within a 
distributed computing environment such as that shown in 
Figures 2D-2E. A network contains gateway 300 and endpoints 
301 and 302. Gateway 302 runs ORB 304. In general, an ORB 
can support different services that are configured and run 
in conjunction with an ORB. In this case, distributed 
kernel services (DKS) include Network Endpoint Location 
Service (NELS) 306, IP Object Persistence (IPOP) service 
308, and gateway service 310. 

The gateway service processes action objects, which are 
explained in more detail below, and directly communicates 
with endpoints or agents to perform management operations. 
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The gateway receives events from resources and passes the 
events to interested parties within the distributed system. 
The NELS works in combination with action objects and 
determines which gateway to use to reach a particular 
resource. A gateway is determined by using the discovery 
service of the appropriate topology driver, and the gateway 
location may change due to load balancing or failure of 
primary gateways. 

Other resource level services may include an SNMP 
(Simple Network Management Protocol) service that provides 
protocol stacks, polling service, and trap receiver and 
filtering functions. The SNMP service can be used directly 
by certain components and applications when higher 
performance is required or the location independence 
provided by the gateways and action objects is not desired. 
A metadata service can also be provided to distribute 
information concerning the structure of SNMP agents. 

The representation of resources within DKS allows for 
the dynamic management and use of those resources by 
applications. DKS does not impose any particular 
representation, but it does provide an object-oriented 
structure for applications to model resources. The use of 
object technology allows models to present a unified 
appearance to management applications and hide the 
differences among the underlying physical or logical 
resources. Logical and physical resources can be modeled a 
separate objects and related to each other using 
relationship attributes. 

By using objects, for example, a system may implement 
an abstract concept of a router and then use this 
abstraction within a range of different router hardware. 
The common portions can be placed into an abstract router 
class while modeling the important differences in 
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subclasses, including representing a complex system with 
multiple objects. With an abstracted and encapsulated 
function, the management applications do not have to handle 
many details for each managed resource. A router usually 
has many critical parts, including a routing subsystem, 
memory buffers, control components, interfaces, and multiple 
layers of communication protocols. Using multiple objects 
has the burden of creating multiple object identifiers 
(OIDs) because each object instance has its own OID. 
However, a first order object can represent the entire 
resource and contain references to all of the constituent 
parts . 

Each endpoint may support an object request broker, 
such as ORBs 320 and 322, for assisting in remote 
object-oriented operations within the DKS environment. 
Endpoint 301 contains DKS-enabled application 324 that 
utilizes object-oriented resources found within the 
distributed computing environment. Endpoint 302 contains 
target resource provider object or application 326 that 
services the requests from DKS-enabled application 324. A 
set of DKS services 330 and 334 support each particular 
endpoint . 

Applications require some type of insulation from the 
specifics of the operations of gateways. In the DKS 
environment, applications create action objects that 
encapsulate commands which are sent to gateways, and the 
applications wait for the return of the action object. 
Action objects contain all of the information necessary to 
run a command on a resource. The application does not need 
to know the specific protocol that is used to communicate 
with the resource. The application is unaware of the 
location of the gateway because it issues an action object 
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into the system, and the action object itself locates and 
moves to the correct gateway. The location independence 
allows the NELS to balance the load between gateways 
independently of the applications and also allows the 
5 gateways to handle resources or endpoints that move or need 
to be serviced by another gateway. 

The communication between a gateway and an action 
object is asynchronous, and the action objects provide error 
handling and recovery. If one gateway goes down or becomes 
10 overloaded, another gateway is located for executing the 

action object, and communication is established again with 
the application from the new gateway. Once the controlling 
gateway of the selected endpoint has been identified, the 
action object will transport itself there for further 
15 processing of the command or data contained in the action 
object. If it is within the same ORB, it is a direct 
transport. If it is within another ORB, then the transport 
can be accomplished with a "Moveto" command or as a 
parameter on a method call. 
20 Queuing the action object on the gateway results in a 

controlled process for the sending and receiving of data 
from the IP devices. As a general rule, the queued action 
objects are executed in the order that they arrive at the 
gateway. The action object may create child action objects 
25 if the collection of endpoints contains more than a single 
ORB ID or gateway ID. The parent action object is 
responsible for coordinating the completion status of any of 
its children. The creation of child action objects is 
transparent to the calling application. A gateway processes 
30 incoming action objects, assigns a priority, and performs 
additional security challenges to prevent rogue action 
object attacks. The action object is delivered to the 
gateway that must convert the information in the action 
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object to a form suitable for the agent. The gateway 
manages multiple concurrent action objects targeted at one 
or more agents, returning the results of the operation to 
the calling application as appropriate. 

In the preferred embodiment, potentially leasable 
target resources are Internet protocol (IP) commands, e.g. 
pings, and Simple Network Management Protocol (SNMP) 
commands that can be executed against endpoints in a managed 
region. Referring again to Figures 2F and 2G, each NIC at a 
gateway or an endpoint may be used to address an action 
object. Each NIC is represented as an object within the 
IPOP database, which is described in more detail further 
below. 

The Action Object IP (AOIP) Class is a subclass of the 
Action Object Class. An AOIP object is the primary vehicle 
that establishes a connection between an application and a 
designated IP endpoint using a gateway or stand-alone 
service. In addition, the Action Object SNMP (AOSnmp) Class 
is also a subclass of the Action Object Class. An AOSnmp 
object is the primary vehicle that establishes a connection 
between an application and a designated SNMP endpoint via a 
gateway or the gateway service. However, the present 
invention is primarily concerned with IP endpoints. 

The AOIP class should include the following: a 
constructor to initialize itself; an interface to the NELS; 
a mechanism by which the action object can use the ORB to 
transport itself to the selected gateway; a security check 
verification of access rights to endpoints; a container for 
either data or commands to be executed at the gateway; a 
mechanism by which to pass commands or classes to the 
appropriate gateway or endpoint for completion; and public 
methods to facilitate the communication between objects. 

The instantiation of an AOIP object creates a logical 
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circuit between an application and the targeted gateway or 
endpoint. This circuit is persistent until command 
completion through normal operation or until an exception is 
thrown. When created, the AOIP object instantiates itself 
as an object and initializes any internal variables 
required. An AOIP may be capable of running a command from 
inception or waiting for a future command. A program that 
creates an AOIP object must supply the following elements: 
address of endpoints; function to be performed on the 
endpoint; and data arguments specific to the command to be 
run. A small part of the action object must contain the 
return end path for the object. This may identify how to 
communicate with the action object in case of a breakdown in 
normal network communications. An action object can contain 
either a class or object containing program information or 
data to be delivered eventually to an endpoint or a set of 
commands to be performed at the appropriate gateway. Action 
objects IP return back a result for each address endpoint 
targeted. 

Using commands such as "Ping", "Trace Route", "Wake-On 
LAN", and "Discovery", the AOIP object performs the 
following services: facilitates the accumulation of metrics 
for the user connections; assists in the description of the 
topology of a connection; performs Wake-On LAN tasks using 
helper functions; and discovers active agents in the network 
environment . 

The NELS service finds a route to communicate between 
the application and the appropriate endpoint. The NELS 
service converts input to protocol, network address, and 
gateway location for use by action objects. The NELS 
service is a thin service that supplies information 
discovered by the IPOP service. The primary roles of the 
NELS service are as follows: support the requests of 
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applications for routes; maintain the gateway and endpoint 
caches that keep the route information; ensure the security 
of the requests; and perform the requests as efficiently as 
possible to enhance performance. 
5 For example, an application requires a target endpoint 

(target resource) to be located. The target is ultimately 
known within the DKS space using traditional network values, 
i.e. a specific network address and a specific protocol 
identifier. An action object is generated on behalf of an 
10 application to resolve the network location of an endpoint. 
The action object asks the NELS service to resolve the 
network address and define the route to the endpoint in that 
network. 

One of the following is passed to the action object to 

15 specify a destination endpoint: an EndpointAddress object; a 
fully decoded NetworkAddress object; or a string 
representing the IP address of the IP endpoint. In 
combination with the action objects, the NELS service 
determines which gateway to use to reach a particular 

20 resource. The appropriate gateway is determined using the 

discovery service of the appropriate topology driver and may 
change due to load balancing or failure of primary gateways. 
An "EndpointAddress" object must consist of a collection of 
at least one or more unique managed resource IDs. A managed 

25 resource ID decouples the protocol selection process from 
the application and allows the NELS service to have the 
flexibility to decide the best protocol to reach an 
endpoint. On return from the NELS service, an 
"AddressEndpoint" object is returned, which contains enough 

30 information to target the best place to communicate with the 
selected IP endpoints. It should be noted that the address 
may include protocol-dependent addresses as well as 
protocol-independent addresses, such as the virtual private 
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network id and the IPOP Object ID. These additional 
addresses handle the case where duplicate addresses exist in 
the managed region. 

When an action needs to be taken on a set of endpoints, 
5 the NELS service determines which endpoints are managed by 
which gateways. When the appropriate gateways are 
identified, a single copy of the action object is 
distributed to each identified gateway. The results from 
the endpoints are asynchronously merged back to the caller 

10 application through the appropriate gateways. Performing 
the actions asynchronously allows for tracking all results 
whether the endpoints are connected or disconnected. If the 
action object IP fails to execute on its target gateway, 
NELS is consulted to identify an alternative path for the 

15 command. If an alternate path is found, the action object 
IP is transported to that gateway and executed. It may be 
assumed that the entire set of commands within one action 
object IP must fail before this recovery procedure is 
invoked. 

20 With reference now to Figure 4, a block diagram shows 

the manner in which data is stored by the IPOP (IP Object 
Persistence) service. IPOP service database 402 contains 
endpoint database table 404, system database table 406, and 
network database table 408. Each table contains a set of 

25 topological objects (TopoObj ects ) for facilitating the 

leasing of resources at IP endpoints and the execution of 
action objects. Information within IPOP service database 
402 allows applications to generate action objects for 
resources previously identified as IP objects through a 

30 discovery process across the distributed computing 

environment. Figure 4 merely shows that the TopoObj ects may 
be separated into a variety of categories that facilitate 
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processing on the various objects- The separation of 
physical network categories facilitates the efficient 
querying and storage of these objects while maintaining the 
physical network relationships in order to produce a 
5 graphical user interface of the network topology. 

With reference now to Figure 5A, a block diagram shows 
the IPOP service in more detail. In the preferred 
embodiment of the present invention, an IP driver subsystem 
is implemented as a collection of software components for 

10 discovering, i.e. detecting, IP "objects", i.e. IP networks, 
IP systems, and IP endpoints by using physical network 
connections. This discovered physical network is used to 
create topology data that is then provided through other 
services via topology maps accessible through a graphical 

15 user interface (GUI) or for the manipulation of other 

applications. The IP driver system can also monitor objects 
for changes in IP topology and update databases with the new 
topology information. The IPOP service provides services 
for other applications to access the IP object database. 

20 IP driver subsystem 500 contains a conglomeration of 

components, including one or more IP drivers 502. Every IP 
driver manages its own "scope 7 ', which is described in more 
detail further below, and every IP driver is assigned to a 
topology manager within topology service 504, which can 

25 serve more than one IP driver. Topology service 504 stores 
topology information obtained from discovery controller 506. 
The information stored within the topology service may 
include graphs, arcs, and the relationships between nodes 
determined by IP mapper 508. Users can be provided with a 

30 GUI to navigate the topology, which can be stored within a 
database within the topology service. 

IPOP service 510 provides a persistent repository 512 
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for discovered IP objects; persistent repository 512 
contains attributes of IP objects without presentation 
information. Discovery controller 506 detects IP objects in 
Physical IP networks 514, and monitor controller 516 
5 monitors IP objects. A persistent repository, such as IPOP 
database 512 , is updated to contain information about the 
discovered and monitored IP objects. IP driver may use 
temporary IP data store component 518 and IP data cache 
component 520 as necessary for caching IP objects or storing 

10 IP objects in persistent repository 512, respectively. As 
discovery controller 506 and monitor controller 516 perform 
detection and monitoring functions, events can be written to 
network event manager application 522 to alert network 
administrators of certain occurrences within the network, 

15 such as the discovery of duplicate IP addresses or invalid 
network masks. 

External applications/users 524 can be other users, 
such as network administrators at management consoles, or 
applications that use IP driver GUI interface 526 to 

20 configure IP driver 502, manage/unmanage IP objects, and 
manipulate objects in persistent repository 512. 
Configuration service 528 provides configuration information 
to IP driver 502. IP driver controller 530 serves as 
central control of all other IP driver components. 

25 Referring back to Figure 2G, a network discovery engine 

is a distributed collection of IP drivers that are used to 
ensure that operations on IP objects by gateways 260, 270, 
and 280 can scale to a large installation and provide 
fault-tolerant operation with dynamic start/stop or 

30 reconfiguration of each IP driver. The IPOP service stores 
and retrieves information about discovered IP objects; to do 
so, the IPOP service uses a distributed database in order to 
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efficiently service query requests by a gateway to determine 
routing, identity, or a variety of details about an 
endpoint. The IPOP service also services queries by the 
topology service in order to display a physical network or 
map them to a logical network, which is a subset of a 
physical network that is defined programmatically or by an 
administrator. IPOP fault tolerance is also achieved by 
distribution of IPOP data and the IPOP service among many 
Endpoint ORBs. 

One or more IP drivers can be deployed to provide 
distribution of IP discovery and promote scalability of IP 
driver subsystem services in large networks where a single 
IP driver is not sufficient to discover and monitor all IP 
objects. Each IP driver performs discovery and monitoring 
on a collection of IP resources within the driver's "scope". 
A driver's scope, which is explained in more detail below, 
is simply the set of IP subnets for which the driver is 
responsible for discovering and monitoring. Network 
administrators generally partition their networks into as 
many scopes as needed to provide distributed discovery and 
satisfactory performance. 

A potential risk exists if the scope of one driver 
overlaps the scope of another, i.e. if two drivers attempt 
to discover/monitor the same device. Accurately defining 
unique and independent scopes may require the development of 
a scope configuration tool to verify the uniqueness of scope 
definitions. Routers also pose a potential problem in that 
while the networks serviced by the routers will be in 
different scopes, a convention needs to be established to 
specify to which network the router "belongs", thereby 
limiting the router itself to the scope of a single driver. 

Some ISPs may have to manage private networks whose 
addresses may not be unique across the installation, like 
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10.0.0.0 network. In order to manage private networks 
properly, first, the IP driver has to be installed inside 
the internal networks in order to be able to discover and 
manage the networks. Second, since the discovered IP 
addresses may not be unique across an entire installation 
that consists of multiple regions, multiple customers, etc., 
a private network ID has to be assigned to the private 
network addresses. In the preferred embodiment, the unique 
name of a subnet becomes "privateNetworkId\subnetAddress" . 
Those customers that do not have duplicate networks address 
can just ignore the private network ID; the default private 

network ID is 0. 

If Network Address Translator (NAT) is installed to 
translate the internal IP addresses to Internet IP 
addresses, users can install the IP drivers outside of NAT 
and manage the IP addresses inside the NAT. In this case, 
an IP driver will see only the translated IP addresses and 
discover only the IP addresses translated. If not all IP 
addresses inside the NAT are translated, an IP driver will 
not able to discover all of them. However, if IP drivers 
are installed this way, users do not have to configure the 
private network within the IP driver's scope. 

Scope configuration is important to the proper 
operation of the IP drivers because IP drivers assume that 
there are no overlaps in the drivers' scopes. Since there 
should be no overlaps, every IP driver has complete control 
over the objects within its scope. A particular IP driver 
does not need to know anything about the other IP drivers 
because there is no synchronization of information between 
IP drivers. The configuration service provides the means to 
allow the DKS components to store and retrieve configuration 
information for a variety of other services from anywhere in 
the networks. In particular, the scope configuration will 
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be stored in the configuration services so that IP drivers 
and other applications can access the information. 

The ranges of addresses that a driver will discover and 
monitor are determined by associating a subnet address with 
a subnet mask and associating the resulting range of 
addresses with a subnet priority. An IP driver is a 
collection of such ranges of addresses, and the subnet 
priority is used to help decide the system address. A 
system can belong to two or more subnets, such as is 
commonly seen with a Gateway. The system address is the 
address of one of the NICs that is used to make SNMP 
queries. A user interface can be provided, such as an 
administrator console, to write scope information into the 
configuration service. System administrators do not need to 
provide this information at all, however, as the IP drivers 
can use default values. 

An IP driver gets its scope configuration information 
from the configuration service, which may be stored using 
the following format: 

scopeID=driverID, anchorname, subnetAddress : subnetMask[ 
:privateNetworkId:privateNetworkName: subnetPriority ] [ , 
subnetAddress: subnetMask: privateNetwor kid: privateNetworkName 

: subnetPriority] ] 

Typically, one IP driver manages only one scope. 
Hence, the "scopelD" and "driverlD" would be the same. 
However, the configuration can provide for more than one 
scope managed by the same driver. "Anchorname" is the name 
in the name space in which the topology service will put the 
IP driver's network objects. 

A scope does not have to include an actual subnet 
configured in the network. Instead, users/administrators 
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can group subnets into a single, logical scope by applying a 
bigger subnet mask to the network address. For example, if 
a system has subnet "147.0.0.0" with mask of "255.255.0.0" 
and subnet "147.1.0.0" with a subnet mask of "255.255.0.0", 
the subnets can be grouped into a single scope by applying a 
mask of "255.254.0.0". Assume that the following table is 
the scope of IP Driver 2. The scope configuration for IP 
Driver 2 from the configuration service would be: 
2=2, ip, 147. 0.0. 0:255. 254. 0.0, 146. 100. 0.0: 255. 255. 0.0, 

69.0.0.0:255.0.0.0. 



Subnet address 


Subnet mask 


147 . 0. 0. 0 


255.255.0.0 


147.1.0.0 


255.255.0.0 


146. 100. 0. 0 


255.255.0.0 


69.0.0.0 


255.0.0.0 



In general, an IP system is associated with a single IP 
address, and the "scoping" process is a straightforward 
association of a driver's ID with the system's IP address. 

Routers and multi-homed systems, however, complicate 
the discovery and monitoring process because these devices 
may contain interfaces that are associated with different 
subnets. If all subnets of routers and multi-homed systems 
are in the scope of the same driver, the IP driver will 
manage the whole system. However, if the subnets of routers 
and multi-homed systems are across the scopes of different 
drivers, a convention is needed to determine a dominant 
interface: the IP driver that manages the dominant interface 
will manage the router object so that the router is not 
being detected and monitored by multiple drivers; each 
interface is still managed by the IP driver determined by 
its scope; the IP address of the dominant interface will be 
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assigned as the system address of the router or multi-homed 
system; and the smallest (lowest) IP address of any 
interface on the router will determine which driver includes 
the router object within its scope. 

5 Users can customize the configuration by using the 

subnet priority in the scope configuration. The subnet 
priority will be used to determinate the dominant interface 
before using the lowest IP address. If the subnet 
priorities are the same, the lowest IP address is then used. 

10 Since the default subnet priority would be M 0", then the 
lowest IP address would be used by default. 

With reference now to Figure 5B, a network diagram 
depicts a network with a router that undergoes a scoping 
process. IP driver Dl will include the router in its scope 

15 because the subnet associated with that router interface is 
lower than the other three subnet addresses. However, each 
driver will still manage those interfaces inside the router 
in its scope. Drivers D2 and D3 will monitor the devices 
within their respective subnets, but only driver Dl will 

20 store information about the router itself in the IPOP 
database and the topology service database. 

If driver Dl's entire subnet is removed from the 
router, driver D2 will become the new "owner" of the router 
object because the subnet address associated with driver D2 

25 is now the lowest address on the router. Because there is 
no synchronization of information between the drivers, the 
drivers will self-correct over time as they periodically 
rediscover their resources. When the old driver discovers 
that it no longer owns the router, it deletes the router's 

30 information from the databases. When the new driver 

discovers the router 7 s lowest subnet address is now within 
its scope, the new driver takes ownership of the router and 
updates the various databases with the router's information. 



« ' in 
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If the new driver discovers the change before the old driver 
has deleted the object, then the router object may be 
briefly represented twice until the old owner deletes the 
original representation. 

There are two kinds of associations between IP objects. 
One is "IP endpoint in IP system" and the other is "IP 
endpoint in IP network". The implementation of associations 
relies on the fact that an IP endpoint has the object IDs 
(OIDs) of the IP system and the IP network in which it is 
located. An IP driver can partition all IP networks, IP 
Systems, and IP endpoints into different scopes. A network 
and all its IP endpoints will always be assigned in the same 
scope. However, a router may be assigned to an IP driver, 
but some of its interfaces are assigned to different IP 
drivers. The IP drivers that do not manage the router but 
manage some of its interfaces will have to create interfaces 
but not the router object. Since those IP drivers do not 
have a router object ID to assign to its managed interfaces, 
they will assign a unique system name instead of object ID 
in the IP endpoint object to provide a link to the system 
object in a different driver. 

Because of the inter-scope association, when the IP 
Object Persistence Service (IPOP) is queried to find all the 
IP endpoints in system, it will have to search not only IP 
endpoints with the system ID but also IP endpoints with its 
system name. If a distributed IP Object Persistence Service 
is implemented, the service has to provide extra information 
for searching among its distributed instances. 

An IP driver may use a security service to check access 
to IP objects. In order to handle large number of objects, 
the security service requires the users to provide a naming 
hierarchy as the grouping mechanism. Figure 5C, described 
below, shows a security naming hierarchy of IP objects. An 
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IP driver has to allow users to provide security down to the 
object level and to achieve high performance. In order to 
achieve this goal, the concepts of "anchor" and "unique 
object name" are introduced. An anchor is a name in the 
naming space which can be used to plug in IP networks. 
Users can define, under the anchor, scopes that belong to 
the same customer or to a region. The anchor is then used 
by the security service to check if a user has access to the 
resource under the anchor. If users want a security group 
defined inside a network, the unique object name is used. A 
unique object name is in the format of: 
IP network - privateNetwor kID/binaryNetworkAddress 
IP system - privateNetworklD/binarylPAddress/system 
IP endpoint- privateNetworklD/binaryNetworkAddress/endpoint 
For example: 

A network "146.84.28.0:255.255.255.0" in privateNetworkID 12 
has unique name: 

12/1/0/0/1/0/0/1/0/0/1/0/1/0/1/0/0/0/0/0/1/1/1/0/0. 

A system "14 6.84.28.22" in privateNetworkID 12 has unique 

name : 

12/1/0/0/1/0/0/1/0/0/1/0/1/0/1/0/0/0/0/0/1/1/1/0/0/0/0/0/1/0 
/1/1/0/system. 

An endpoint "146.84.28.22" in privateNetworkld 12 has unique 
name : 

12/1/0/0/1/0/0/1/0/0/1/0/1/0/1/0/0/0/0/0/1/1/1/0/0/0/0/0/1/0 

/1/1/0/endpoint . 

By using an IP-address, binary-tree, naming space, one 
can group all the IP addresses under a subnet in the same 
naming space that need to be checked by the security 
service . 

For example, one can set up all IP addresses under subnet 
"146.84.0.0:255.255.0.0" under the naming space 
12/1/0/0/1/0/0/1/0/0/1/0/1/0/1/0/0 
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and set the access rights based on this node name. 

With reference now to Figure 5C, the IP Object Security 
Hierarchy is depicted. Under the root, there are two fixed 
security groups. One is "default" and the other is "all". 
5 The name of "default" can be configured by within the 

configuration service. Users are allowed to configure which 
subnets are under which customer by using the configuration 
service . 

Under the first level security group, there are router 

10 groups and subnet groups. Those systems that have only one 
interface will be placed under the subnets group. Those 
systems that have more than one interface will be placed 
under the router group; a multi-home system will be placed 
under the router group. 

15 Every IP object has a "securityGroup" field to store 

which security group it is in. The following describes how 
security groups are assigned. 

When a subnet is created and it is not configured for 
any customers, its securityGroup is 

20 Vdefault/subnet/sujbnetAddress". When a subnet is created 
and it is configured in the "customerl" domain, its 
"securityGroup" value is "/customerl/subnet/siLbnetAddress" . 

When an IP endpoint is created and it is not configured 
for any customers, its "securityGroup" value is 

25 Vdefault/subnet/subnetAddress". The subnet address is the 
address of the subnet in which the IP endpoint is located. 
When an IP endpoint is created and it is configured in the 
"customerl" domain, its "securityGroup" value is 
Vcustomerl/subnet/sujbnetAddress". The subnet address is 

30 the address of the subnet in which the IP endpoint is 
located. 

When a single interface IP system is created, it has 
the same "securityGroup" value that its interface has. When 
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a router or mult i -home system is created, the 
"securityGroup" value depends on whether all of the 
interfaces in the router or multi-home system are in the 
same customer group or not. If all of the interfaces of the 
router or multi-home system are in the same customer group, 
e.g., "customerl", its "securityGroup" value is 
Vcustomerl/router". If the interfaces of the router or 
multi-home system are in more than one domain, its 
"securityGroup" value is Vall/router" . 

These are the default security groups created by an IP 
driver. After the security group is created for an object, 
IP driver will not change the security group unless a 
customer wants to change it. 

The IP Monitor Controller, shown in Figure 5A, is 
responsible for monitoring the changes of IP topology and 
objects; as such, it is a type of polling engine, which is 
discussed in more detail further below. An IP driver stores 
the last polling times of an IP system in memory but not in 
the IPOP database. The last polling time is used to 
calculate when the next polling time will be. Since the 
last polling times are not stored in the IPOP database, when 
an IP Driver initializes, it has no knowledge about when the 
last polling times occurred. If polling is configured to 
occur at a specific time, an IP driver will do polling at 
the next specific polling time; otherwise, an IP driver will 
spread out the polling in the polling interval. 

The IP Monitor Controller uses SNMP polls to determine 
if there have been any configuration changes in an IP 
system. It also looks for any IP endpoints added to or 
deleted from an IP system. The IP Monitor Controller also 
monitors the statuses of IP endpoints in an IP system. In 
order to reduce network traffic, an IP driver will use SNMP 
to get the status of all IP endpoints in an IP system in one 
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query unless an SNMP agent is not running on the IP system. 
Otherwise, an IP driver will use "Ping" instead of SNMP. An 
IP driver will use "Ping" to get the status of an IP 
endpoint if it is the only IP endpoint in the system since 
the response from "Ping" is quicker than SNMP. 

With reference now to Figure 6, a block diagram shows a 
set of components that may be used to implement scope-based 
security access in the present invention. Login security 
subsystem 602 provides a typical authentication service, 
which may be used to verify the identity of users during a 
login process. All-user database 604 provides information 
about all users in the DKS system, and active user database 
606 contains information about users that are currently 
logged into the DKS system. 

Discovery engine 608, similar to discovery controller 
506 in Figure 5, detects IP objects within an IP network. 
Polling engine, similar to monitor controller 516 in Figure 
5, monitors IP objects. A persistent repository, such as 
IPOP database 612, is updated to contain information about 
the discovered and monitored IP objects. IPOP also obtains 
the list of all users from the security subsystem which 
queries its all-users database 604 when initially creating a 
DSC (Device Scope Context) object. During subsequent 
operations to map the location of a user to an ORB, the DSC 
manager will query the active user database 606. 

The DSC manager queries IPOP for all endpoint data 
during the initial creation of DSCs and any additional 
information needed, such as decoding an ORB address to an 
endpoint in IPOP and back to a DSC using the IPOPOid, the ID 
of a network object as opposed to an address. 

An administrator can fill out the security information 
with respect to access user or endpoint access and designate 
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which users and endpoints will have a DSC. If not 
configured by the administrator, a default DSC will be used. 
While not all endpoints will have an associated DSC, IPOP 
endpoint data 612, login security subsystem 602, and 
5 security information 604 are needed in order to create the 
initial DSCs. 

The DSC manager, acting as a DSC data consumer, 
explained in more detail further below, then listens on this 
data waiting for new endpoints or users or changes to 

10 existing ones. DSC configuration changes are advertised by 
a responsible network management application, such as a 
configuration service. Some configuration changes will 
trigger the creation of more DSCs, while others will cause 
DSC data in the DSC database to be merely updated. 

15 Ml DSCs are stored in DSC database 618 by DSC creator 

616, which also fetches DSCs upon configuration changes in 
order to determine whether or not a DSC already exists. The 
DSC manager primarily fetches DSCs from DSC database 618, 
but also adds runtime information, such as ORB ID. 

20 With reference now to Figure 7A, a flowchart depicts a 

portion of an initialization process in which a network 
management system prepares a security subsystem for user 
access to network-related objects. The process begins with 
the assumption that a network administrator has already 

25 performed configuration processes on the network such that 
configuration information is properly stored where 
necessary. The discovery engine performs a discovery 
process to identify IP objects and stores these in the IPOP 
persistence storage (step 702) . 

30 The DSC creator in the DSC manager generates "initial" 

DSC objects and stores these within the DSC database (step 
704) . 
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A source user then performs a login on a source 
endpoint (step 706) . An application may use a resource, 
termed a target resource, located somewhere within the 
distributed system, as described above. Hence, the endpoint 
5 on which the target resource is located is termed the 

"target endpoint" . The endpoint on which the application is 
executing is termed the "source endpoint" to distinguish it 
from the "target endpoint", and the user of the application 
is termed the "source user". 

10 As part of the login process, the security subsystem 

updates the active user database for the ORB on which the 
application is executing (step 708) . The initialization 
process is then complete. 

With reference now to Figure 7B, a flowchart depicts 

15 further detail of the initialization process in which the 
DSC objects are initially created and stored. Figure 7B 
provides more detail for step 704 shown in Figure 7A. 

The process shown in Figure 7B provides an outline for 
the manner in which the DSC manager sets up associations 

20 between users and endpoints and between endpoints and 

endpoints. These associations are stored as special objects 
termed "DSC objects". A DSC object is created for all 
possible combinations of users and endpoints and for all 
possible combinations of endpoints and endpoints. From one 

25 perspective, each DSC object provides guidance on a 

one-to-one authorization mapping between two points in which 
a first point (source point) can be a user or an endpoint 
and a second point (target point) is an endpoint. 

Figure 7B depicts the manner in which the DSC manager 

30 initially creates and stores the DSC objects for subsequent 
use. At some later point in time, a user associated with an 
application executing on a source endpoint may request some 
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type of network management action at a target endpoint, or a 
network management application may automatically perform an 
action at a target endpoint on behalf of a user that has 
logged into a source endpoint. Prior to completing the 
necessary network management task, the system must check 
whether the source user has the proper authorization to 
perform the task at the target endpoint. 

Not all network monitoring and management tasks require 
that a user initiate the task. Some network management 
applications will perform tasks automatically without a user 
being logged onto the system and using the network 
management application. At some point in time, an 
application executing on a source endpoint may automatically 
attempt to perform an action at a target endpoint. Prior to 
completing the necessary network management task, the system 
must check whether the source endpoint has the proper 
authorization to perform the task at the target endpoint in 
a manner similar to the case of the source user performing 
an action at a target endpoint. 

When the system needs to perform an authorization 
process, the previously created and stored DSC objects can 
be used to assist in the authorization process. By storing 
the DSC objects within a distributed database, a portion of 
the authorization process has already been completed. 
Hence, the design of the system has required a tradeoff 
between time and effort invested during certain system 
configuration processes and time and effort invested during 
certain runtime processes. A configuration process may 
require more time to complete while the DSC objects are 
created, but runtime authorization processes become much 
more efficient. 

The DSC objects are created and stored within a 
distributed database during certain configuration processes 



AUS920010375US1 

42 

throughout the system. A new system usually undergoes a 
significant installation and configuration process. 
However, during the life of the system, endpoints may be 
added or deleted, and each addition or deletion generally 
requires some type of configuration process. Hence, the DSC 
objects can be created or deleted as needed on an ongoing 
basis . 

The network management framework also provides an 
additional advantage by storing the DSC objects within a 
highly distributed database. Because the present invention 
provides a network management system for an application 
framework over a highly distributed data processing system, 
the system avoids centralized bottlenecks that could occur 
if the authorization processes had to rely upon a 
centralized security database or application. The first DSC 
fetch requires relatively more time than might be required 
with a centralized subsystem. However, once fetched, a DSC 
is cached until listeners on the configuration data signal 
that a change has occurred, at which point the DSC cache 
must be flushed. 

The process in Figure 7B begins with the DSC manager 
fetching endpoint data from the IPOP database (step 710) . 
The IPOP database was already populated with IP objects 
during the discovery process, as mentioned in step 702 of 
Figure 7A. The DSC manager fetches user data from the 
all-user database in the security subsystem (step 712) . 
Configuration data is also fetched from the configuration 
service database or databases (step 714), such as ORB IDs 
that are subsequently used to fetch the ORB address. A 
network administration application will also use the 
configuration service to store information defined by the 
administrator. The DSC manager then creates DSC objects for 
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each user/endpoint combination (step 716) and for each 
endpoint/endpoint combination (step 718), and the DSC object 
creation process is then complete. 

With reference now to Figure 7C, a flowchart depicts 

5 further detail of the initial DSC object creation process in 
which DSC objects are created and stored for an 
endpoint/user combination. Figure 7C provides more detail 
for step 716 in Figure 7B. The process shown in Figure 7C 
is a loop through all users that can be identified within 

10 the all-user database. In other words, a set of user 

accounts or identities have already been created and stored 
over time. However, all users that have been authorized to 
use the system do not have the same authorized privileges. 
The process shown in Figure 7C is one of the first steps 

15 towards storing information that will allow the system to 
differentiate between users so that it can adaptively 
monitor the system based partially on the identity of the 
user for which the system is performing a monitoring task. 
The process in Figure 7C begins by reading scope data 

20 for a target endpoint from the IPOP database (step 720). 

The DSC creator within the DSC manager then reads scope data 
for a source user from the IPOP database (step 722) . A 
determination is then made as to whether or not the source 
user is allowed to access the target endpoint (step 724) . 

25 This determination can be made in the following manner. 
After the initial DSC is obtained, the source user 
information is used to make an authorization call to the 
security subsystem as to whether or not the source user has 
access to the security group defined in the DSC. It may be 

30 assumed that the security system can perform this function 
efficiently, although the present invention does not depend 
on auto-generation of security names or security trees. The 
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present invention should not be understood as depending upon 
any particular implementation of security authorization. 

If not, then the process branches to check whether 
another user identity should be processed. If the source 
5 user is allowed to access the target endpoint, then a DSC 
object is created for the current source user and current 
target endpoint that are being processed (step 726) . The 
DSC object is then stored within the DSC database (step 
728) , and a check is made as to whether or not another 

10 source user identity requires processing (step 729) . If so, 
then the process loops back to get and process another user, 
otherwise the process is complete. 

With reference now to Figure 7D, a flowchart depicts 
further detail of the initial DSC object creation process in 

15 which DSC objects are created and stored for an 

endpoint /endpoint combination. Figure 7D provides more 
detail for step 718 in Figure 7B. The process shown in 
Figure 7D is a loop through all endpoints that can be 
identified within the IPOP database; the IPOP database was 

20 already populated with IP objects during the discovery 
process, as mentioned in step 702 of Figure 7A. During 
runtime operations, an application executing on a source 
endpoint may attempt to perform an action at a target 
endpoint. However, not all endpoints within the system have 

25 access to requesting actions at all other endpoints within 
the system. The network management system needs to attempt 
to determine whether or not a source endpoint is authorized 
to request an action from a target endpoint. The process 
shown in Figure 7D is one of the first steps towards storing 

30 information that will allow the system to differentiate 

between endpoints so that it can monitor the system based 
partially on the identity of the source endpoint for which 
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the system is performing a monitoring task. 

The process in Figure 7D begins by reading scope data 
for a target endpoint from the IPOP database (step 730) . 
The DSC creator within the DSC manager then reads scope data 

5 for a source endpoint from the IPOP database (step 732) . A 
determination is then made as to whether or not the source 
endpoint is allowed to access the target endpoint (step 734) 
based on the scope defined in the DSC. For example, a 
simple scope of X.Y.Z.* will allow an address of X.Y.Z.Q 

10 access. If not, then the process branches to check whether 
another source endpoint should be processed. If the source 
endpoint is allowed to access the target endpoint, then a 
DSC object is created for the source endpoint and target 
endpoint that are currently being processed (step 736) . The 

15 DSC object is then stored within the DSC database (step 
738), and a check is made as to whether or not another 
source endpoint requires processing (step 739) . If so, then 
the process loops back to get and process another endpoint, 
otherwise the process is complete. 

20 The components and subsystems described above with 

respect to Figures 6-7D are used to restrict administrative 
user access to various operations and functionality within 
the network management framework. The following description 
of Figures 8A-14B describe particular operations and 

25 functionality that may be available to administrative users 
within the network management framework. In particular, 
Figures 8A-14B show various ways in which scopes and anchors 
are used to perform certain tasks within a single network 
management framework that is being used to manage a 

30 multi-customer environment. More specifically, Figures 

8A-9B depict a manner in which an administrative user may 
view the topology of a set of network-related objects that 
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are being managed by the network management framework, 
whereas Figures 10A-14B depict a process for configuring 
information within the network management framework so that 
it may manage the networks of multiple customers. 
5 As described above, an IP driver subsystem is 

implemented as a collection of software components for 
discovering, i.e. detecting, network "objects", such as IP 
networks, IP systems, and IP endpoints by using physical 
network connections. The collected data is then provided 

10 through other services via topology maps accessible through 
a GUI or for the manipulation of other applications. The IP 
driver system can also monitor objects for changes in IP 
topology and update databases with the new topology 
information. The IPOP service provides services for other 

15 applications to access the IP object database. 

Referring again to Figure 5A, IP driver subsystem 500 
contains a conglomeration of components, including one or 
more IP drivers 502. Every IP driver manages its own 
"scope", and every IP driver is assigned to a topology 

20 manager within topology service 504, which stores topology 
information obtained from discovery controller 506. The 
information stored within the topology service may include 
graphs, arcs, and the relationships between nodes determined 
by IP mapper 508. Users can be provided with a GUI to 

25 navigate the topology, which can be stored within a database 
within the topology service. 

The topology service provides a framework for 
DKS-enabled applications to manage topology data. In a 
manner similar to the IPOP service, the topology service is 

30 actually a cluster of topology servers distributed 

throughout the network. All of the functions of the 
topology service are replicated in each topology server. 
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Therefore, a client can attach to any server instance and 
perform the same tasks and access the same objects. Each 
topology-related database is accessible from more than one 
topology server, which enables the topology service to 
recover from a server crash and provide a way to balance the 
load on the service. 

Topology clients create an instance of a 
TopoClientService class. As part of creating the 
TopoClientService instance, the class connects to one of the 
topology servers. The topology server assumes the burden of 
consolidating all of the topology information distributed 
over the different topology servers into a single combined 
view. The topology service tracks changes in the objects of 
interest for each client and notifies a client if any of the 
objects change. 

The topology service may have a server-cluster design 
for maximizing availability. As long as there is at least 
one instance of the topology server running, then clients 
have access to topology objects and services. The topology 
service design allows for servers to occasionally fail. 
Each server is aware of the state of all the other server 
instances. If one instance fails, the other servers know 
immediately and automatically begin to rebuild state 
information that was lost by the failed server. A client's 
TopoClientService instance also knows of the failure of the 
server to which it is connected and re-connects to a 
different server. The objects residing at a failed topology 
server are migrated to the other topology servers when the 
drivers owning those objects have re-located. 

The topology service is scalable, which is important so 
that the service may be the central place for all network 
topology objects for all of the different DKS-related 
applications in order to provide efficient service for 
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millions of objects. As the number of clients, drivers, and 
objects increase, an administrator can create more instances 
of topology servers, thereby balancing the workload. Using 
the server cluster approach, any growth in the number of 
clients, drivers, and objects is accommodated by simply 
adding more servers. The existing servers detect the 
additional instances and begin to move clients and drivers 
over to the new instances. The automated load-balancing is 
achieved because the clients and objects are not dependent 
on any one server instance. 

In order to provide a service for an entire enterprise, 
all of the enterprise's objects generally do not reside in 
the same database. There may be many reasons that make it 
undesirable to require that all topology objects be stored 
in the same database instance. For example, a database 
simply may not be reachable across an international 
boundary, or the volume of information going into the 
database may exceed a single database's capacity. 
Therefore, the topology objects may span databases, and 
there may be relationships between objects in different 
databases. However, it may be assumed that all topology 
objects in a domain reside in the same database. For 
example, all IP objects for a single enterprise do not 
necessarily reside in the same database as the enterprise's 
IP space may be split into many domains, e.g., a southwest 
IP domain and a northeast IP domain, but each domain may 
reside in different databases and still have relations 
between their objects. Hence, it is possible to have two 
objects related to each other even though they are in 
different databases. Since the name of the domain is part 
of the id of the object, each object can be uniquely 
identified within the entire topology service. 

When an application is installed and configured to use 
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the DKS services, the application provides some information 
to the topology service about the different types of 
TopoObjects it will be creating. This class information 
closely resembles the network entities that a driver will be 
managing. For example, an IP application works with 
Network, System, and Endpoint resource types, as described 
previously with respect to Figure 4. Giving TopoObjects a 
resource type enables client applications to identify, 
group, and query the databases based on domain-specific 
types. Each resource type may have many different types of 
relations that the driver may create, and the most common 
type may be the containment relation, which shows the 
containment hierarchy of a domain. Each relation type has a 
corresponding ViewData object, which provides information 
that an administrative console needs to create a view of the 
TopoObjects. For example, the ViewData object may contain 
members like BackgroundColor and LayoutType that are used to 
construct a graphical display of the object. Relations can 
be created between any two TopoObjects. The TopoObjects can 
be owned by the same driver, different drivers in the 
domain, or even drivers in different domains. 

With reference now to Figure 8A, a flowchart depicts a 
process for creating topology data. The process begins when 
one or more discovery engines scan physical networks until a 
new device is found (step 802) . A determination is made as 
to whether or not a network object exists for the network in 
which the endpoint has been found (step 804) . If not, then 
a network object is created (step 806), otherwise the 
process continues. 

In either case, a determination is then made as to 
whether or not a system object exists for the system in 
which the endpoint has been found (step 808) . If not, then 
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a system object is created (step 810), otherwise the process 
continues. In either case, an endpoint object is then 
created for the discovered device (step 812), and all of the 
created objects are then stored within the IPOP database 

5 (step 814) . The created objects are then mapped into the 
current topology (step 816), and the topology service 
creates topology objects (step 818) and stores them within 
the topology database (step 820) . The process of 
discovering a physical network or device and storing 

10 appropriate information is then complete. 

With reference now to Figure 8B, a flowchart depicts a 
process for listening for physical network changes that 
affect topology objects. The process begins with a 
determination of whether or not one or more polling engines 

15 has found a system or device that has failed (step 832) . If 
not, then a determination is made as to whether or not a new 
device has been discovered (step 834) . If not, then the 
process loops back to continue monitoring the networks. 

If either a new device is discovered or a device has 

20 failed, then the appropriate changes are made to the objects 
representing the physical devices that have been affected by 
updating the IPOP database (step 836) . For example, if a 
new device is found, then appropriate steps are made to 
create the necessary objects in a manner similar to steps 

25 804-820 in Figure 8A. A determination is then made as to 
whether or not the detected change affects the topology 
(step 838), and if not, then the process is complete. If 
the topology has been affected, then the topology database 
is updated as necessary (step 840), and the process of 

30 listening for network changes and reflecting those changes 
within the topology is complete. 

With reference now to Figure 9A, a figure depicts a 
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graphical user interface window that may be used by a 
network or system administrator to view the topology of a 
network that is being monitored. Window 900 depicts a 
simple network showing router device 902, endpoint 904, and 
5 endpoint 906. In addition, line 908 shows a relation 

between endpoint 904 and router 902, and line 910 shows a 
relation between endpoint 906 and router 902. Each of the 
icons 902-906 represents a TopoObject that is maintained by 
the topology service. 
10 With reference now to Figure 9B, a figure depicts a 

graphical user interface window that shows the topology of a 
network that has changed. Window 930 in Figure 9B shows the 
same network as depicted within window 900 of Figure 9A 
except that an endpoint has failed and has been deleted from 
15 the current topology. Window 930 depicts a simple network 
showing router device 932, endpoint 934, and line 936 for 
the relation between endpoint 934 and router 932. 

As noted previously, Figures 8A-9B depict one 
administrative operation that may be performed in 
20 conjunction with the present invention, whereas Figures 
10A-14B depict another administrative operation; these 
examples are included herein to provide a context in which 
the network management framework uses IP drivers, scopes, 
anchors, and other framework components in order to provide 
25 a robust network management framework for supporting the 
management of the networks of multiple customers in an 
integrated manner. 

One particular problem that a robust network management 
framework for a service provider must confront is the fact 
30 that many customers of a service provider may have 

software-based and/or hardware-based network address 
translators, or NATs. Each network address within a given 
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domain serviced by a NAT can be assumed to be unique. 
However, across multiple NATs, each network address within 
the entire set of network addresses cannot be assumed to be 
unique. In fact, the potential for duplicate addresses over 
such a large, highly distributed network is quite high. 
Even if the service provider is managing only one customer 
within a particular network management environment, the same 
problem might also exist because a single customer may 
operate multiple NATs for multiple networks. This type of 
problem is illustrated in more detail in Figures 10A-10B. 

With reference now to Figure 10A, a block diagram 
depicts a known configuration of software and/or hardware 
network components linking multiple networks. A 
computer-type device is functioning as firewall/NAT 1020, 
which is usually some combination of software and hardware, 
to monitor data traffic from external network 1022 to 
internal protected network 1024. Firewall 1020 reads data 
received by network interface card (NIC) 1026 and determines 
whether the data should be allowed to proceed onto the 
internal network. If so, then firewall 1020 relays the data 
through NIC 1028. The firewall can perform similar 
processes for outbound data to prevent certain types of data 
traffic from being transmitted, such as HTTP (Hypertext 
Transport Protocol) Requests to certain domains. 

More importantly for this context, the firewall can 
prevent certain types of network traffic from reaching 
devices that reside on the internal protected network. For 
example, the firewall can examine the frame types or other 
information of the received data packets to stop certain 
types of information that has been previously determined to 
be harmful, such as virus probes, broadcast data, pings, 
etc. As an additional example, entities that are outside of 
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the internal network and lack the proper authorization may 
attempt to discover, through various methods, the topology 
of the internal network and the types of resources that are 
available on the internal network in order to plan 
electronic attacks on the network. Firewalls can prevent 
these types of discovery practices. 

While firewalls may prevent certain entities from 
obtaining information from the protected internal network, 
firewalls may also present a barrier to the operation of 
legitimate, useful processes. For example, in order to 
ensure a predetermined level of service, benevolent 
processes may need to operate on both the external network 
and the protected internal network; a customer system is 
more efficiently managed if the management software can 
dynamically detect and dynamically configure hardware 
resources as they are installed, rebooted, etc. Various 
types of discovery processes, status polling, status 
gathering, etc., may be used to get information about the 
customer's large, dynamic, distributed processing system. 
This information is then used to ensure that 
guality-of-service guarantees to the customer are being 
fulfilled. However, firewalls might block these system 
processes, especially discovery processes. 

Firewall/NAT 1020 also performs network address 
translation between addresses on external network 1022 and 
addresses on internal network 1024. In the example, system 
1030 connects to internal network 1024 via NIC 1032; system 
1034 connects to internal network 1024 via NIC 1036; and 
system 1038 connects to internal network 1024 via NIC 1040. 
Each NIC has its own MAC (Media Access Control layer) 
address, which is a guaranteed unique hardware address in 
the NIC that is used to address data packets to and from the 
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system that is using a given NIC . Network Address 
Translator (NAT) 1020 presents all of the systems on 
internal network 1024 to external network 1022 with a 
single, public, IP address. However, systems 1030, 1034, 
and 1038 have addresses which are unique within internal 
network 1024. NAT 1020 retrieves the addresses within the 
data packets flowing between the internal network and the 
external network, translates the addresses between the two 
domains, stores the addresses back into the data packets, 
and forwards the data packets. 

The internal network supports a private address space 
with globally non-unique address, whereas the external 
network represents a public address space of globally unique 
addresses. A NAT device is used to manage the connectivity 
of the private network with the outside world; the NAT 
device bridges the internal network and the external network 
and converts addresses between the two address spaces. 
Within a private network behind a NAT, an enterprise may 
have its own private address space without concern for 
integrating the private address space with the global 
Internet, particularly with the predominant IPv4 address 
space that is currently in use. 

NATs are helpful for certain enterprises that do not 
require full connectivity for all of its devices. However, 
NATs present barriers for certain functionality. A NAT must 
have high performance in order to perform address 
translation on all data packets that are sent and received 
by a private network. In addition, a network management 
framework for a highly distributed system may be forced to 
coordinate its actions across multiple NAT devices within a 
single customer or across multiple customers. For example, 
systems 1030, 1034, and 1038 have addresses which are unique 
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within internal network 1024. However, another internal 
network within the same enterprise may duplicate the 
addresses that are used within internal network 1024. 

When contending with multiple NATs, the network 
management framework cannot assume uniqueness among private 
network addresses. In some prior art systems, it would have 
been straightforward to use the private network address of a 
device as a unique key within the network management 
applications because the private network address has a 
unique association with a networked device. In a highly 
distributed system, the network management framework needs 
to store many data items in an efficient manner yet cannot 
rely upon a scheme that uses the private network addresses 
as unique keys for managing those data items. 

Future IT solutions may not need to confront the same 
problems because the Internet is moving towards using a new 
standard IP protocol known as IP Version 6 (IPv6) that will 
have a much larger address space. However, a current 
network management solution must confront legacy issues of 
maintaining currently installed hardware. 

Prior art solutions have generally included dedicated 
boxes or devices that perform address translation. These 
solutions tend to be specific modifications to an operating 
system or kernel, which reduces the benefit of having 
standardized implementations of software platforms. In 
other words, some applications may not be compatible with 
the solution. In addition, such solutions may require 
installing a dedicated device for each system, which is 
prohibitive . 

With reference now to Figure 10B, a block diagram 
depicts a service provider connected to two customers that 
each have subnets that may contain duplicate network 



AUS920010375US1 

56 

addresses. As noted above, multiple internal networks 
within a highly distributed data processing system may 
contain duplicate addresses. Service provider 1050 manages 
networks and applications for multiple customers and stores 
5 its data within multi-customer database 1052. Customer 1054 
has a network of devices that includes subnet 1056 that 
connect with the larger network through NAT 1058; customer 
1064 has a network of devices that includes subnet 1066 that 
connect with the larger network through NAT 1068. Duplicate 

10 network addresses could appear within subnets 1056 and 1066. 
In order to provide certain services in a seamless fashion 
such that both customers can be managed by the service 
provider as a single logical network, the service provider 
requires a network management framework that can handle 

15 duplicate network addresses. 

The network management framework that is described 
herein can manage multiple networks over which duplicate 
addresses might appear, e.g., as shown in Figure 10B, such 
that the distributed network management framework is 

20 operable across multiple NATs . The manner in which the 

network management is performed is described further below 
in more detail. 

With reference now to Figure 11A, a block diagram shows 
a set of components that may be used to implement 

25 multi-customer management across multiple networks in which 
duplicate addresses may be present. Figure 11A depicts 
components that are similar to components introduced in 
other figures above. User security subsystem 1106 provides 
a user authentication and authorization service, which may 

30 be used to verify the identity of users, such as 
administrators, during a login process and during 
administrative operations. IP drivers 1108 detect IP 
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objects within an IP network. Gateway/NEL service 1110 
provides action object processing within gateways. A 
persistent repository, such as IPOP database 1112, is 
updated to contain information about the discovered and 
monitored IP objects. Other ORB or core services 1114 may 
also access IPOP database 1112. 

Customer address manager service 1116 queries IPOP 1112 
during operations that allow an administrator to resolve 
addressability problems. Customer logical network creator 
1118 fetches administrator input about the groupings of 
physical networks into a logical network, as may be provided 
by an administrator through an application GUI, such as the 
GUI shown in Figure 13. From this input, the various scopes 
of the physical networks are combined to create a logical 
scope as previously described above. 

VPN creator 1120 fetches administrator input concerning 
which physical networks belong to which customer. The 
administrator can provide a name to each physical network 
collection, which is used by the anchorname creator 1122 to 
define an anchorname, which is highest level name used to 
describe a logical network. The final name of each physical 
network is a combination of the anchorname and the name 
assigned to each logical network. For example, the name of 
a logical network consisting of the physical networks 
146.5.*.* would be "austin\downtown\secondf loor" comprising 
the anchorname="austin" and the name="downtown\secondf loor . " 
The anchorname creator supplies a name to the IP Driver 
subsystem by combining the anchorname, determined from the 
scope configuration, and the name of the physical network 
element object from IPOP. Finally, a customer ID creator 
1124 uses the collection of IDs used by all customers to 
generate a new unique customer identifier when required by 
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IPOP; the identifiers are used rather than strings for 
efficient database searches of large number of network 
objects. During subsequent operations to m-ap the location 
of a user to an ORB, customer address manager service 1116 
5 queries may query an active-user database similar to that 
shown in Figure 6. 

With reference now to Figures 11B-11D, some simplified 
pseudo-code depicts the manner in which action objects and 
endpoint objects can be implemented in an object-oriented 
10 manner. Figure 11B shows a class for action objects, while 
Figures 11C-11D show classes for endpoint objects. 

With reference now to Figure 12A, a flowchart depicts a 
portion of an initialization process in which a network 
management system prepares for managing a set of networks 
15 with multiple NATs. It is assumed that a network 

administrator has already performed configuration processes 
on the network such that configuration information is 
properly stored where necessary. The process begins when a 
multi-customer administrator creates DKS VPN IDs during 
20 installation (step 1202) . For example, after the ORB has 
started, the ORB starts a Command Line Interface (CLI) 
Service through which an administrator can issue CLI 
commands to create VPN IDs within the IPOP database, such as 
"ipop create VPN" used by customer and VPN ID creator 1124 
25 in order to create a unique customer ID or a unique VPN ID. 

The process then continues with the multi-customer 
administrator creating network scope for one or more 
customers (step 1204). Multi-customer regions may also be 
created, which refers to the managing a region that consists 
30 of two or more customers for which care has to be taken not 
to intermix different customer data. At this point, the 
physical network is discovered via a discovery engine, such 
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as the IP driver service, which performs a discovery process 
to identify IP objects and stored those in the IPOP 
persistence storage. For all customer locations, all of the 
physical networks that have been discovered are displayed to 
the administrator so that the administrator can conveniently 
apply names to the discovered objects/networks. In 
addition, multiple address problems are determined and 
displayed to the administrator, who is then required to 
assign a VPN ID to a customer, e.g., by using an application 
GUI such as that shown in Figure 13. 

Part of the customer scope, i.e. a logical scope 
consisting of a collection of physical networks as described 
previously, is the customer anchorname text array, e.g., 
M ibm\usa\Austin", the customer name, and a unique customer 
ID, as created by customer address manager service 1116 in 
Figure 11A. The hash number is computed by the customer 
base text name, e.g., "ibm", the network addresses, e.g., 
all subnets of reserved public addresses, and VPN IDs. 

The administrator then resolves any outstanding 
addressability problems (step 1206) . For example, a large 
corporation may have subnets "10.0.0.*" on each floor of a 
large office. After those have been resolved, then the 
system stores the mapping of customers, VPN IDs, customer 
anchornames, and customer networks in the IPOP database 
(step 1208), and the initialization process is then 
complete . 

With reference now to Figure 12B, a flowchart depicts 
further detail of the initialization process in which the 
administrator resolves addressability problems. Figure 12B 
provides more detail for step 1206 shown in Figure 12A in 
which an administrator proceeds to resolving identified 
addressability problems. 
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The process begins, during the initialization process, 
as an ORB starts the customer address manager (step 1212) . 
The customer address manager then finds the identity of the 
administrator that is performing various address management 
5 functions through a network management application (step 
1214) . At this point, the identity of the network 
administrator may be used to ensure than the administrator 
has the proper authorization parameters. However, for the 
sake of explanation, it may be assumed that an administrator 

10 with multi-customer rights has access to the GUI to create 
VPNs for multiple customers, i.e. it may be assumed that an 
administrator has the proper authorization for working with 
the data from multiple customers. The multi-customer 
administrator uses the administrator GUI shown in Figure 13, 

15 which uses the customer address manager, to display all of 
the discovered networks for the administrator's customer or 
customers (step 1216) . 

After retrieving this information, the customer address 
manager may then allow the administrator to assign VPN IDs 

20 to those networks for which it can be determined that the 
networks have an addressability problem (step 1218) . The 
assigned VPN IDs are then stored as updated information 
within the network objects within IPOP (step 1220) . The 
scope information is also updated with a VPN ID (step 1222); 

25 initially, many scopes are defined as n VPN - 0", which means 
no VPN address. The VPN ID creator ensures that unique VPN 
IDs are created such that duplicate addresses can exist 
within a VPN that has an assigned VPN ID. This portion of 
the initialization process is then complete. The manner in 

30 which the administrator assigns VPN IDs is explained in more 
detail with respect to Figure 12C. 

In order to determine which networks require a VPN ID, 
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the customer address manager sorts through all of the 
network addresses, looking for problematic addresses. For 
example, a set of 255 public addresses, such as "10.0.0.*", 
are reserved for local network purposes. Hence, even if two 
networks within the network management system do not have 
colliding local network addresses, the potential for future 
collisions exists. 

With reference now to Figure 12C, a flowchart depicts 
further detail of the process in which the administrator 
assigns VPN IDs. Figure 12C provides more detail for step 
1218 shown in Figure 12B. The process begins by displaying 
those networks have been determined to need a VPN ID 
assigned since a duplicate address exists, as determined 
with respect to step 1218 above, to the current 
administrator (step 1232). The customer address manager 
then displays a list of possible VPN IDs from which the 
administrator may choose (step 1234), and the administrator 
is able to define VPN IDs as necessary if not already 
defined (step 1236) . VPN IDs could have been previously 
defined through the configuration service, most likely 
during installation. However, at configuration time, the 
networks have not yet been discovered, so it is not possible 
for the system to know if and where duplicate addresses 
exist. While the figures are described with respect to the 
actions of a single administrator, a highly distributed 
system has a collection of administrators that are typically 
not in one location. Hence, one of goals of the DKS 
management framework is to detect errors and allow the 
administrators to have input into the manner in which the 
errors should be corrected. 

A determination is then made as to whether the 
administrator is a multi-customer administrator (step 1238) . 
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If not, then the VPN ID that has been chosen by the 
administrator can be assigned to the networks of the 
administrator's customer (step 1240). If the administrator 
is a multi-customer administrator, then the customer address 
5 manager must get a specific customer from the administrator 
(step 1242), and the chosen VPN ID is assigned to the 
specified customer (step 1244) . This portion of the 
initialization process is then complete. After these 
initialization steps, the administrator has an overall 
10 addressing scheme that should be coherent. The IP 

addresses, VPN IDs, and other information, when taken 
together, provides a scheme for unique identifiers that the 
management system can use to manage the devices throughout 
the system. 

15 With reference now to Figure 13, a figure depicts a 

graphical user interface window that may be used by a 
network or system administrator to set monitoring parameters 
for resolving address collisions. Window 1350 is a dialog 
box that is associated with a network management 

20 application; a system or network administrator is required 
to create or enter VPN IDs to resolve duplicate addresses 
that have been detected, such as physical network addresses 
1352 and 1354. An administrator could also invoke the 
application on a regular basis when necessary, or it could 

25 be invoked automatically by the network management system 

when address collisions are detected. "Set" button 1374 and 
"Clear" button 1376 allow the administrator to store the 
specified values or to clear the specified parameters. 
Checkbox 1378 allows an administrator to quickly change the 

30 VPN ID for an entire physical scope indicated within window 
1350. 

Figures 14A-14B depict examples of processes that may 
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be performed by the network management system after system 
configuration/initialization when an administrator is using 
a network management application to perform a certain 
operation, such as a simple IP "Ping" command as shown in 
5 the example. While the example shows a simple IP "Ping" 
action, a more complex action could include a software 
distribution application that installs software on endpoints 
throughout the distributed data processing system. 

With reference now to Figure 14A, a flowchart shows the 

10 overall process for performing an IP "Ping" within a 
multi-customer, distributed data processing system 
containing multiple private networks. The process begins 
when an ORB starts a private network multi-customer manager 
(PNMCM) that is used by the system to perform certain 

15 actions, such as requesting an IP "Ping" (step 1402) . The 
user of the application, which in this case is a network or 
system administrator for a particular customer, launches an 
application associated with the PNMCM (step 1404) . Within 
the application, the administrator chooses an endpoint and 

20 requests an IP "Ping" action, most likely from hitting a 
"Ping" button within the GUI (step 1406) . 

The PNMCM manager attempts to fetch the requested 
endpoint from the IPOP database using only the IP address as 
specified or selected by an administrator within an 

25 application GUI (step 1408) . A determination is then made 
as to whether IPOP returns duplicate endpoints (step 1410) . 
If not, then the process branches to show the results of the 
requested "Ping" action. 

If there is a collision among duplicate IP addresses, 

30 they are displayed to the administrator along with the 

previously associated VPN IDs that help to uniquely identify 
the endpoints (step 1412) . The administrator is requested 
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to choose only one of the duplicate endpoints (step 1414) , 
and after choosing one, the administrator may request to 
perform the "Ping" action on the selected endpoint (step 
1416) . The PNMCM displays the results of the "Ping" action 
5 to the administrator (step 1418), and the process is 
complete . 

With respect to Figure 14B, a flowchart depicts a 
process for obtaining and using an application action object 
(AAO) within the network management system of the present 

10 invention. An application action object is a class of 

objects that extends an action object class in a manner that 
is appropriate for a particular application. The 
process begins when an application requests, from the 
gateway service, an application action object (AAO) for a 

15 "Ping" action (AAOIP) against a target endpoint (step 1422) . 
The process assumes that the administrator has already 
chosen the source and target endpoints through some type GUI 
within a network management application. 

The gateway service asks the NEL service to decode the 

20 target endpoint from the request (step 1424) . As noted 

previously, one of the primary roles of the NEL service is 
to support the requests from applications for routes, as 
explained above with respect to Figure 3. The NEL service 
then asks the IPOP service to decode the endpoint object 

25 (step 1426) . Assuming that the processing has been 

successfully accomplished, IPOP returns an appropriate AAOIP 
object to the NEL service, including VPN ID if necessary 
(step 1428), and the NEL service returns the AAOIP object to 
the gateway service (step 1430) . The gateway service then 

30 returns the AAOIP object to the application (step 1432) . 
The application then performs the desired action (step 
1434), such as an IP "Ping", and the process is complete. 
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The description of Figures 11A-14B explain a 
methodology for configuring the network management framework 
to manage the networks of multiple customers, which may have 
conflicting physical network addresses; by employing scopes 
5 and anchors, the conflicts can be resolved. As described 
above with respect to Figures 5A-5C, when a network is 
discovered, it is associated with a particular scope, and 
each scope relates to an anchor. Scope configuration is 
important to the proper operation of the IP drivers because 

10 IP drivers assume that there are no overlaps in the drivers' 
scopes. Since there should be no overlaps, every IP driver 
has complete control over the objects within its scope. 
When IP mapper is informed that a new network has been 
discovered, it uses the scope associated with the network to 

15 determine with which anchor, i.e. customer, the newly 

discovered network should be associated, and the appropriate 
updates are also made within the topology database. 

Assuming that an administrative user has the proper 
security access, the administrative user should have the 

20 ability to modify various management aspects of scopes and 
anchors. However, scope manipulation can be quite complex. 
For example, an administrative user may incorrectly attempt 
to change the manner in which a set of endpoints is managed 
such that a conflict between scopes arises. Hence, the 

25 network management framework needs to be able to handle 

dynamic changes in scope while monitoring for errors such as 
scope overlap. In addition, the network management 
framework should enable dynamic changes in administrative 
responsibility over different scopes and also enable 

30 security monitoring for such administrative changes. These 
types of changes are described in a high-level manner with 
respect to Figure 15. 
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With reference now to Figure 15, a block diagram 
depicts a logical organization of network-related objects 
that may be managed within different scopes on behalf of a 
plurality of customers whose physical networks are being 
5 administered using the network management framework of the 
present invention. After a discovery process, a distributed 
data processing system is determined to contain physical 
devices that may be represented by the network-related 
objects shown in Figure 15: endpoints 1501-1506 have been 

10 dynamically discovered; endpoint 1504 and endpoint 1505 

reside within system 1507; endpoint 1501, endpoint 1502, and 
endpoint 1504 reside within network 1508, while endpoint 
1503, endpoint 1505, and endpoint 1506 reside within network 
1509. In this example, system 1507 may be a router. 

15 At some point in time during the initial phases of 

configuring a distributed data processing system, the 
physical networks of the distributed data processing system 
may have been discovered, but the physical networks would 
not yet have been associated or assigned to logical networks 

20 on behalf of customers. In this case, all of the 

network-related objects 1501-1509 are managed using a single 
IP driver within a single scope; for instance, this initial 
scope may be initially assigned to a management entity, i.e. 
the service provider that is managing the distributed data 

25 processing system on behalf of a set of customers. 

At some subsequent point in time, an administrative 
user may desire to dynamically segment the distributed data 
processing system into two customer scopes; the scope of the 
initial IP driver is changed to include only the endpoints 

30 within network 1508, and another IP driver is introduced to 
be responsible for monitoring the endpoints within network 
1509. It is assumed that the administrative user has 



AUS920010375US1 

67 

appropriate security access to an administrative application 
that provides access to a Distributed IP Driver Change 
Manager (DICM) for initiating such management actions; the 
DICM may be a component within the IP drivers or may be a 
5 separate service that coordinates these types of management 
actions with the IP drivers. 

For this example, the DICM would perform the following 
deletion actions: endpoint 1503, endpoint 1505, and endpoint 
1506 would be deleted from the endpoint table is associated 

10 with the initial IP driver in the IPOP database; references 
to endpoint 1505 would be deleted from the system table that 
is associated with system 1507 in the IPOP database; and 
references to endpoint 1505 would be deleted from the 
network table that is associated with network 1509 in the 

15 IPOP database. 

Although not shown in Figure 4, other tables may be 
stored within the IPOP database for use in these operations 
to change the configuration of the IP drivers. In this 
case, the DICM moves the network-related objects to 

20 temporary tables: the system object for system 1507 is moved 
to an orphan system table in the IPOP database; the network 
object for network 1509 is moved to an orphan network table 
in the IPOP database; and the endpoint objects for endpoint 
1503, endpoint 1505, and endpoint 1506 are moved to an 

25 orphan endpoint table in the IPOP database. All of the 

objects within the orphan object tables are then marked as 
seeds to be used by the newly introduced IP driver upon its 
startup to perform an abbreviated, more efficient, discovery 
process. Rather than configuring the new IP driver instance 

30 to physically discover its assigned network of devices, the 
new IP driver instance can be configured to perform 
discovery using the objects in IPOP that have been marked as 
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IPOP seeds. When the new IP driver is started on its ORB 
for the first time, the seeds are used to create new IPOP 
objects and topology objects, including the relations 
between objects, with new object IDs and other non-physical 
5 network-related data. After that point in time, any 

management operations that need to be performed with the 
objects through the new IP driver would require appropriate 
security access as configured for the new IP driver. 

At this point in time, the distributed data processing 

10 system can be viewed as two logical networks that are being 
managed by two IP drivers on behalf of a single management 
entity. However, an administrative user may then assign 
each of the logical networks to a customer such that the 
logical networks are managed on behalf of two customers. 

15 From that point on, any administrator-initiated operations 
would require the appropriate security access as configured 
for those customers. Any attempts to change the scopes of 
the logical networks or to create a new IP driver across 
customer lines would generate a security event for review by 

20 an administrative user, which is explained in more detail 
with respect to Figure 16. 

With reference now to Figure 16, a flowchart depicts a 
process for handling certain types of scope-related events. 
The process begins with the Distributed IP Driver Change 

25 Manager (DICM) detecting a configuration change that affects 
the configuration of the current scopes or introduces a new 
IP driver (step 1602) . The DICM may register multiple 
object listeners throughout the distributed data processing 
system for these purposes. 

30 In response to receiving an event, the DICM determines 

whether a change has been detected in an anchor name object 
(step 1604) . If so, then the DICM generates a customer 
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security breach event (step 1606), which causes a network 
console application to log the event (step 1608) and display 
the event within a GUI for review by an administrative user 
(step 1610), after which the process is considered complete. 
5 Because a change in anchor name is equivalent to moving a 
logical network between customers, the change is critical 
and needs to be verified. The administrative user can then 
determine whether the event was actually generated by an 
administrator-initiated action. In this manner, 

10 administrative operations are subject to a feedback loop 

that automatically detects certain changes that affect the 
customer to which a network-related object is assigned. In 
a multi-customer environment with many administrative users, 
the administrative user that approves of the change may be 

15 in a completely different management office than the 
administrative user that initiated the event. 

If the event is not a change in the anchor name, then a 
more detailed test is performed to determine whether the 
change has resulted in a change in scope that affects the 

20 customer to which a network-related object is assigned. A 

determination is made as to which IP drivers are affected by 
the detected change (step 1612), and for each scope assigned 
to the determined IP drivers, all network-related objects 
(networks, systems, and endpoints) are retrieved (step 

25 1614) . The DICM then loops through the retrieved objects by 
getting a next object (step 1616) and determining whether 
the customer associated with the object differs from the 
other objects within the same scope (step 1618) . If so, 
there has been some type of breach in security related to 

30 the various customers because a single scope can only 

include objects assigned to a single customer. Hence, the 
DICM again generates a customer security breach event at 
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step 1606, which is handled again at steps 1610 and 1612. 

Otherwise, if there are more objects to be processed (step 
1620), then the DICM continues to loop through those objects 
to determine whether there has been a customer security 
5 breach event. 

With reference now to Figure 17A-17B, a pair of 
flowcharts depicts a process for relocating network-related 
objects based on a change of scope initiated by an 
administrator or for configuring multiple customers within a 

10 distributed data processing system. In a manner similar to 
that described with respect to Figure 15, a multicustomer 
administrator wants to segment a single distributed data 
processing system into a multi-customer environment. An 
administrative user changes the scope configuration 

15 pertaining to scope or IP driver by defining a new scope to 
encompass a certain physical network, after which the 
topology service will be able to display a network object or 
icon for the newly introduced customer. The change may be 
effected through a network management console application at 

20 the direction of the administrative user. 

The process begins by detecting that a new IP driver 
has been started or that a change has been made in the 
configuration of one of the existing scopes (step 1702) . 
All IP drivers that are affected by the change are 

25 determined (step 1704) , and the process then loops through 
the scopes of the affected IP drivers. 

A first or next affected IP driver is identified (step 
1706) , depending upon the iteration in the loop through the 
IP drivers, and any objects within one or more scopes of the 

30 affected IP driver are examined to determine which objects 
are now out-of -scope for the affected IP driver, i.e. 
outside of the scopes assigned to the affected IP driver, 



AUS920010375US1 

71 

based on the newly defined IP driver's scope (s) or the 
change in the configuration of one or more scopes (step 
1708) . 

A first or next out-of-scope object is obtained (step 
5 1710), depending upon the iteration in the loop through the 
out-of-scope objects, and the out-of-scope object is marked 
as a seed object (step 1712), which will cause the object to 
be subsequently processed in a special manner when the new 
IP driver performs its rediscovery process. The 

10 out-of-scope object is then moved to an orphan object table 
in the IPOP database (step 1714) corresponding to its type 
of network-related object, i.e. network object, system 
object, or endpoint object. A determination is then made as 
to whether there are additional out-of-scope objects to be 

15 processed (step 1716) . If so, then the process branches 
back to step 1710 to process another out-of-scope object. 
If all of the out-of-scope objects have been processed, then 
the rediscovery process may begin. 

Appropriate configuration values are set for the IP 

20 driver that is responsible for the newly configured scope to 
indicate that the IP driver is to perform a rediscovery 
process on the seed objects in the IPOP database (step 
1718) . A determination is then made as to whether the IP 
driver is already executing or whether it is being 

25 initialized (step 1720) . 

If the IP driver was already executing, then the 
processing within the IP driver differs as it performs 
certain actions in anticipation of the rediscovery process. 
As a first step, the configuration listeners for the IP 

30 driver detect a change in the IP driver's configuration 

(step 1722), most likely in conjunction with notification 
from a configuration service. In response, the IP driver 
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flushes any write operations that are pending for the IPOP 
database (step 1724) to ensure that those updates are 
reflected in the IPOP database before the IP driver begins 
performing its monitoring and discovery duties under a new 
5 configuration. For similar reasons, the IP driver flushes 
its cache of IPOP objects (step 1726) . The IP driver then 
reads all objects defined to be within its scope (which may 
be a newly configured scope) from the IPOP database (step 
1728), and for any of those objects that are marked as seed 

10 objects, the IP driver performs a rediscovery process in 

which it creates new IPOP objects for the seed objects (step 
1730) . In the rediscovery process, the IP driver 
regenerates non-physical network information using newly 
generated identifiers, such as unique numbers that are used 

15 by the DKS services, object IDs, anchor names that may have 
changed for the scope, and relationships between with other 
objects. The process then branches as the processing of 
this IP driver within the IP driver loop is complete. 

If the IP driver was not already executing at step 

20 1720, then the IP driver is newly initialized, which it may 
determine by reading a configuration value that directs the 
IP driver to perform a rediscovery process using IPOP seeds 
rather than performing a full discovery process on the 
networks within its scopes. The rediscovery process for the 

25 newly initialized IP driver is similar to that described 

above. The IP driver reads all objects defined to be within 
its scope from the IPOP database (step 1730) , and for any of 
those objects that are marked as seed objects, the IP driver 
performs a rediscovery process in which it creates new IPOP 

30 objects for the seed objects (step 1732) . The process then 
branches as the processing of this IP driver within the IP 
driver loop is complete. 
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A determination is then made as to whether there are 
other affected IP drivers (step 1736), and if so, then the 
process branches back to step 1706 to process additional 
scopes. If there are no other affected IP drivers, then 
5 additional configuration processing can be performed as part 
of the operation of the network management console 
application that initiated the change in scope. For 
example, if an administrative user was defining a new 
logical network within the distributed data processing 

10 system, then the anchorname that was entered by the user, 

such as through an application window similar to that shown 
in Figure 13, is associated with all of the objects in a 
newly defined or newly configured logical network (step 
1738) . In addition, all of the affected objects in the IPOP 

15 database could be indicated as being "customer-def ined" 

(step 1740) . This indication assists in determining whether 
there has been an unwarranted modification of an anchor name 
or customer association as described above with respect to 
Figure 16. 

20 In addition, the IP mapper creates a customer container 

object for each defined or reconfigured customer (step 1742) 
so that the topology service can display the customer 
objects (step 1744), and the administrator is notified that 
the operation is complete (step 1746) . 

25 The advantages of the present invention should be 

apparent in view of the detailed description of the 
invention that is provided above. A network management 
framework flexibly manages multiple customers within a 
highly distributed system. The network management system is 

30 able to provide security while allowing for dynamic changes 
in administrative responsibility for various networks and 
customers. The network management framework allows for a 
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variety of dynamic reconfigurations of logical networks for 
multiple customers. For example , scopes can be moved 
between customers, or new customers can be introduced such 
that pre-existing scopes must be logically divided. 
5 It is important to note that while the present 

invention has been described in the context of a fully 
functioning data processing system, those of ordinary skill 
in the art will appreciate that the processes of the present 
invention are capable of being distributed in the form of 

10 instructions in a computer readable medium and a variety of 
other forms, regardless of the particular type of signal 
bearing media actually used to carry out the distribution. 
Examples of computer readable media include media such as 
EPROM, ROM, tape, paper, floppy disc, hard disk drive, RAM, 

15 and CD-ROMs and transmission-type media, such as digital and 
analog communications links. 

The description of the present invention has been 
presented for purposes of illustration but is not intended 
to be exhaustive or limited to the disclosed embodiments. 

20 Many modifications and variations will be apparent to those 
of ordinary skill in the art. The embodiments were chosen 
to explain the principles of the invention and its practical 
applications and to enable others of ordinary skill in the 
art to understand the invention in order to implement 

25 various embodiments with various modifications as might be 
suited to other contemplated uses. 



